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abstract: The purpose of this study was to develop a model for evaluating a professional 
development school program to enact an evidence-based model for a continuous cycle of 
program improvement. Guided by the logic model for program evaluation, we developed three 
survey Instruments based on the professional development school standards of the National 
Council for Accreditation of Teacher Education to collect feedback from seniors just complet¬ 
ing the program, from their cooperating teachers, and from program graduates completing 
their 3rd year of teaching. A total of 115 seniors, 135 cooperating teachers, and 38 graduates 
completed the surveys. Based on the quantitative and qualitative data from this study, adjust¬ 
ments were made to the program. The findings also provided a baseline for future professional 
development school program evaluation. 

Over the past 25 years, enthusiasm for the 
establishment of professional development 
schools (PDSs) surpassed researchers’ ability 
to document this movement’s success. Fob 
lowing Goodlad’s seminal book A Place Called 
School (1984), teacher educators across the 
nation attempted to improve their programs 
by implementing the PDS model. Universi- 
ties developed new partnerships with public 
schools; internships were extended to increase 
the amount of time that preservice teachers 
spent in schools; and national licensing agen- 
cies promoted standards to bolster this new 
direction in teacher education. Although a 


substantial number of PDSs still exist, ques- 
tions remain regarding their potential to meet 
the movement’s initial promises. 

Researchers viewed PDSs as having the 
potential to improve teacher education, en- 
hance professional development, increase stu¬ 
dent achievement, and provide a research site 
for collaborative efforts (Moguel, 1997). Al¬ 
though many teacher educators have claimed 
positive effects on preservice and in-service 
teachers’ instructional practices, minimal 
credible evidence exists to document such 
impacts (Teitel, 2001). Efforts to document 
the effectiveness of PDSs (Teitel, 2001) have 
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been undermined by such questions as What 
constitutes a true PDS? Which outcomes 
should be included in a program’s evaluation? 
and How should outcomes be measured and 
by whom? Consequently, the ease with which 
teacher educators may implement such pro- 
grams belies the difficulties associated with 
their evaluation. 

Such questions challenged our ability to 
document our program’s effectiveness. Similar 
to other university faculty, we discussed the 
benefits of adopting a PDS framework in the 
late 1980s, enthusiastically implemented such 
a program in 1991, and remained confident of 
its effectiveness. Throughout, we relied on an- 
ecdotal data from cooperating teachers, whom 
we called on-site teacher educators ( OSTEs ), 
and graduates to evaluate our program. No 
systematic data collection was conducted to 
confirm their statements. Given the time and 
resources needed to operate a professional de- 
velopment program, we never seemed to have 
the energy to systemically document whether 
our confidence was warranted. 

Context for Our PDS Evaluation 

Our elementary teacher education program 
adopted the goals from a traditional PDS 
framework (Moguel, 1997). We hoped our 
new partnerships with public school teachers 
and administrators would improve the quality 
of our teacher education programs, enhance 
professional development efforts, and improve 
public school students’ achievement. Using 
a theme-based approach with cohort teams, 
our program combined coursework with ex- 
tensive field experiences in partnership sites 
(Antonek, Matthews, & Levin, 2005). Under- 
graduates completed an introductory course 
and internship during their sophomore year, 
then applied for membership on a cohort team 
during their junior and senior years, where 
they participated in inquiry seminars, methods 
courses, internships, and student teaching (an 
estimated 1,000 hours in the classroom). Of 
the students who applied for our program after 
completing the introductory course, about 
60% were accepted; another 5% to 10% 


withdrew from the program before or during 
student teaching. After 8 years of implementa¬ 
tion, we complied with local public school of¬ 
ficials’ request to place our students primarily 
in Title I schools. 

Because of the ongoing nature of our 
teacher education program and our goal of 
gathering data for continuous program im¬ 
provement, we used a logic model design for 
evaluation. Compared to other commonly 
used evaluation models, the logic model links 
theories and assumptions with the inputs, 
activities, outputs, and outcomes of a project 
(W. K. Kellogg Foundation, 1998, 2004). 
The pictorial nature and flexible design of the 
logic model requires systematic thinking and 
planning from the evaluators and the program 
developers, who were one and the same in this 
case. By emphasizing connections among theo¬ 
ries, activities, and outcomes, the logic model 
points out areas of strength and weakness (i.e., 
of the program) and allows stakeholders to find 
the best interpretation of the evaluation data 
(Rossi, Freeman, & Lipsey, 1999; W. K. Kel¬ 
logg Foundation, 1998, 2004). We describe our 
development of an evaluation measure based 
on this framework in the “Method” section. 

The purpose of this evaluation was to pro¬ 
vide data-based recommendations for our PDS 
program by comparing the feedback from sev¬ 
eral elementary constituents—teacher candi¬ 
dates just completing the program, classroom 
teachers supervising the field experiences, and 
graduates after they completed a 3rd year of 
teaching. Three questions guided our assess¬ 
ment: 

How do our senior elementary preservice 
teachers perceive the effectiveness of 
our program? 

How do graduates of the program perceive 
the program’s effectiveness? 

What is the impact of the program on our 
school partners? 

Method 

To design a formative evaluation for the pur¬ 
pose of providing ongoing feedback to program 
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developers, an evaluation team was formed, 
composed of the present authors: a program 
evaluator, a department chair, an assistant 
department chair, an elementary education 
program director, and a school administrator. 
Monthly meetings were held to discuss the 
evaluation design, instrumentation, data col- 
lection, and data analysis for the evaluation 
project. Based on the review of the five PDS 
standards of the National Council for Ac- 
creditation of Teacher Education (2001; i.e., 
the learning community; accountability and 
quality assurance; collaboration; diversity and 
equity; and structure, resources, and roles) and 
the goals of our PDS programs, a logic model 
was designed to capture the activities, outputs, 
outcomes, and the impact of the project (see 
Figure 1). Because of the ongoing nature of 
the project, the evaluation focused on the 
outcomes of the project. 

The program developers created three sur- 
vey instruments based on the PDS standards of 
the NCATE (2001) and the goals and objec- 
tives of the program. These instruments were 
designed to align with these standards and the 
program objectives (see Appendixes A and B). 

The Preservice Teacher Survey was de- 
signed for undergraduates in their senior year 
of study. It contained 38 items: 35 multiple- 
choice items and 3 open-ended questions. The 
survey assessed two major areas: The first part 
contained 18 items regarding coursework, and 
the second part contained 16 items regarding 
participants’ program experiences. Both were 
based on a 6-point Likert-type scale (strongly 
disagree, disagree, neutral, agree, strongly agree, 
N/A). Item 35 asked participants to rate the 
program’s quality (outstanding, good, mediocre, 
poor); Item 36 asked them to explain the rat¬ 
ing; Item 37 asked for suggestions to improve 
the program; and the final item asked par¬ 
ticipants to provide examples of their schools’ 
efforts to close the achievement gap. The reli¬ 
ability (Cronbach’s alpha) of this instrument 
reached .89. 

The Graduate Survey contained 41 
items: 18 related to the overall program and 
17 related to course content, with Items 
36-38 being the same as Items 35-37 from 
the Preservice Teacher Survey. The Gradu¬ 


ate Survey used the same 6-point Likert- 
type scale used with the Preservice Teacher 
Survey. Items 39-41 were included to gather 
retention data from the participants. The re¬ 
liability (Cronbach’s alpha) of the Graduate 
Survey was .86. 

The On-Site Teacher Educator Survey 
comprised four subscales: Intern Evalua¬ 
tion (13 items), Team Leader Evaluation 
(8 items), Impact on Professional Develop¬ 
ment (6 items), Quality of University Teacher 
Education Program (1 item). The first three 
subscales were based on the same 5-point 
Likert-type scale (strongly disagree, disagree, 
neutral, agree, strongly agree); the fourth, a 
different 5-point scale (outstanding, very good, 
good, fair, poor). Open-ended questions asked 
respondents for explanations regarding their 
evaluation of the program’s quality, sugges¬ 
tions for improvement, and examples of how 
the program influenced student achievement 
and their professional development. The reli¬ 
ability (Cronbach’s alpha) of this instrument 
was .83. 

In this evaluation, 115 seniors, 135 
OSTEs, and 38 graduates completed the sur¬ 
veys, for response rates of 85%, 74%, and 42%, 
respectively. 

Findings 

We applied specific criteria to determine pro¬ 
gram quality and success. Regarding the first 
research question, we looked at the percent¬ 
age of responses in the top two ratings on the 
survey; then, we followed up whenever pos¬ 
sible with a content analysis of open-ended 
responses. We set a criterion level of 80%, 
based on the department’s estimation of what 
we believed would be an acceptable response 
rate to demonstrate program quality. Regard¬ 
ing open-ended questions, we considered a 
response significant if at least 20% of respon¬ 
dents cited it. 

Preservice Teachers' Perspective 

Of the 18 preservice teachers’ responses re¬ 
garding program content, 16 met our 80% 


Activities Outputs Outcomes Impact 



Figure 1. Logic model. 

Note. UNCG = University of North Carolina-Greensboro; PDS = professional development school; OSTEs = on-site teacher educators. 
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criterion (see Table 1). Students believed that 
they taught in supportive classroom environ- 
ments, that they had adequate opportunities 
to communicate with and observe classroom 
teachers and learn about their professional 
responsibilities, that they adapted teaching 
practices to different students’ needs, that 
they worked with culturally and linguisti¬ 
cally diverse students, and that they provided 
instruction in a variety of formats. Two items 
with lower student ratings included (1) not 
having enough opportunities for interns to 
work with parents from diverse backgrounds 
and others in the community and (2) not be¬ 
ing able to observe and participate in shared 
decision making at the school. With program 
experiences, students viewed methods courses 
favorably, found classroom teachers and uni¬ 
versity supervisors as helpful and supportive, 
and rated the overall teacher education pro¬ 
gram quite highly. Concerns related to the 
effectiveness of the sophomore introductory 
teaching course, all licensure courses except 
physical education (i.e., art, dance, health, 
and music), and their preparation to work ef¬ 
fectively with special-needs students. 

Every preservice teacher except one pro¬ 
vided comments to the open-ended questions. 
Three major themes were noted: university 
coursework, school experiences, and support 
and collaboration. Participants requested 
greater coordination between university 
personnel and classroom teachers regarding 
course assignments, greater coherence be¬ 
tween the university’s recommended instruc¬ 
tional activities and actual classroom activi¬ 
ties, greater emphasis on hands-on learning in 
methods (as opposed to theories), more plan¬ 
ning times with teachers, and more feedback 
from university and public school personnel. 
Regarding the achievement gap questions, 
participants offered multiple responses: how 
having interns allowed teachers to differen¬ 
tiate instruction (n = 45), the availability 
of opportunities to work with small groups 
(n = 44), the ability to provide immediate 
feedback (n = 7), the benefits of more one-to- 
one interaction (n = 20), and the creativity 
they brought to the classroom from methods 
courses (n = 17). 


Graduates' Perspective 

Fewer graduate responses regarding course 
content met our criterion (n = 11 versus n = 
16; see Table 2). Although they still rated the 
overall program highly, graduates wished that 
they had had more opportunities to work with 
other teachers and school personnel, to learn 
more about the professional aspects of teach¬ 
ing, and to interact with parents from diverse 
backgrounds. Moreover, they requested ad¬ 
ditional information about technology use, 
and they lowered their rating of the extent 
to which they might assume the role of an 
OSTE. Like preservice teachers, graduates 
requested more opportunities to work with 
special-needs students and to observe shared 
decision making in schools. Regarding pro¬ 
gram experiences, they lowered their ratings of 
some methods courses in that they requested 
a strengthening of social studies, language 
arts, and children’s literature methods courses. 
Regarding other courses, they lowered their 
ratings of our introductory teaching course 
and licensure courses (i.e., art, music, health, 
physical education, and dance). Regardless of 
their concerns, graduates still highly rated the 
support they received from school and univer¬ 
sity personnel, their internship experiences, 
and the overall quality of the program. 

Among the 38 graduates who responded 
to the survey, 4 had left the teaching field 
(11%). Based on these data, we extrapolate 
that the retention rate is 89% for our gradu¬ 
ates after 3 years; however, with only a 42% 
return rate, this may be overly optimistic. 
The participants’ reasons for leaving included 
career change (n = 2), parental leave (n = 1), 
and poor administration at the site (n = 1). 

Furthermore, 16 graduates in this evalua¬ 
tion reported that they were very likely to stay 
in the classroom for the next 5 years (43%), 
whereas 5 stated that they were not very likely 
(14%). Nineteen participants reported that 
they were very likely to stay in the education 
field (51%), whereas 4 stated that they were 
not very likely (11%). Of those graduates who 
were teaching, all except 4 stated that they 
would likely stay in the classroom for the next 
5 years because they did not know how they 
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16. I had opportunities to observe and participate in shared decision 43 (37.39) 46(40.00) 19 (16.52) 6 (5.22) 1 (0.87) 0 (0.00) 

making at the school.® 

17. I felt welcomed in the schools. 76 (66.09) 35 (30.43) 4 (3.48) 0 (0.00) 0 (0.00) 0 (0.00) 

18. I am committed to being an OSTE once I gain experience teaching. 59(51.30) 41(35.65) 14(12.17) 0(0.00) 0(0.00) 1(0.87) 





Part 2: Program experiences 

19. CUI 250 provided me with adequate information to make informed 25(21.74) 49(42.61) 22 (19.13) 13(11.30) 1 (0.87) 5(4.35) 

decisions about teaching. 3 

20. My internship experiences helped to prepare me for the classroom. 84 (73.04) 30 (26.09) 0 (0.00) 1 (0.87) 0 (0.00) 0 (0.00) 
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16. I had opportunities to observe and participate in shared decision 8 (21.6) 12 (32.4) 11 (29.7) 6 (16.2) 0(0.0) 0(0.0) 

making at the school. 8 

17. I felt welcomed in the schools. 16(43.2) 17(45.9) 2 (5.4) 1(2.7) 1(2.7) 0(0.0) 

18. I am committed to being an OSTE once I gain experience teaching. 8 14(37.8) 12(32.4) 7(18.9) 1(2.7) 0(0.0) 3(8.1) 




Part 2: Course content 

19. CUI 250 provided me with adequate information to make informed 4(10.8) 20 (54.1) 8 (21.6) 3(8.1) 2(5.4) 0(0.0) 

decisions about teaching. 3 

20. My internship experiences helped to prepare me for the classroom. 18(48.6) 14 (37.8) 3 (8.1) 2(5.4) 0(0.0) 0(0.0) 
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could balance the demands of the profession 
with starting a family. A few mentioned (n = 
3) concerns regarding stress or salary as pos- 
sible reasons why they might leave teaching. 

OSTEs' Perspective 

OSTEs were overwhelmingly positive in rat- 
ing their interns’ preparation; that is, 10 of 13 
responses met criterion (see Table 3). Interns 
were rated strongly in their ability to provide 
content instruction, work with diverse popu- 
lations and be collaborative, use technology 
in their instruction, effectively use different 
instructional formats and assessments to pro- 
mote learning, and likely become successful 
1 st-year teachers. They expressed concerns 
with classroom management and their ability 
to work with parents and teach students with 
special needs. 

Classroom teachers viewed the program 
as having a positive impact on their school, 
and they viewed it as an important part of 
their school’s identity. According to the open- 
ended responses, the interns allowed teachers 
to differentiate instruction by offering tutoring 
and by providing more opportunities for small 
group instruction. Moreover, teachers noted 
the positive effects of integrating into their 
classroom routines the new ideas, strategies, 
and techniques that their teacher candidates 
brought to the learning community. 

Concerns related to the university’s abil¬ 
ity to provide direct professional development 
and to communication between the university 
and teachers over a particular student. Teach¬ 
ers also requested more time to meet with 
interns to discuss and plan instruction. 

Discussion and 
Recommendations 

Instead of relying primarily on anecdotal evi¬ 
dence, we collected systematic evidence re¬ 
garding our program’s effectiveness through 
this evaluation. The surveys allowed us to 
evaluate our impressions, and the logic model 
promoted greater staff awareness of the rela¬ 
tionship among our program’s goals, its day-to¬ 


day operation, and national standards. Finally, 
although the survey findings largely confirmed 
what we knew from anecdotal evidence, they 
helped us develop additional goals based on 
the different perspectives of our students, co¬ 
operating teachers, and graduates. 

The evidence overwhelmingly supported 
our program’s effectiveness as it related to the 
content of our methods courses and seminars, 
the involvement of students during intern¬ 
ships and student teaching, and our rela¬ 
tionships with classroom teachers. Preservice 
teachers worked closely with their OSTEs 
in supportive classrooms to provide instruc¬ 
tion for students—particularly, those who 
struggled. Although this collaboration pre¬ 
pared our students for the daily pressures of 
teaching as they entered the profession, there 
never appeared to be enough time to complete 
all the necessary tasks. Regardless of our suc¬ 
cesses, all participants—preservice teachers, 
graduates, and OSTEs—wished for more time 
in the classroom and more instruction related 
to working in diverse settings, communicating 
with parents, and addressing the needs of the 
most challenging students. 

At a more macrolevel, concerns related to 
our program’s operation. For example, our pre- 
service teachers and graduates questioned the 
value and appropriateness of certain courses 
and experiences. As a result, we restructured 
our introductory course, and we now look 
forward to future evaluations to see if we 
adequately addressed their concerns. We also 
started to question the relevance of state- 
required licensure courses (e.g., art, dance, 
health, music, physical education) given the 
demands of classroom teaching. Such ratings 
may be related to the fact that classroom 
teachers are no longer required to provide 
such instruction in classrooms. Our preservice 
teachers questioned the appropriateness of 
these courses, and graduates provided even 
lower evaluations. Perhaps we could use this 
time to restructure our program to increase 
the number of opportunities to deal with issues 
of differentiation and diversity. Additionally, 
everyone raised concerns regarding the need 
for more communication between the univer¬ 
sity and the public schools. Greater attention 
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needs to be given to how our program might 
better address these needs. 

These results raised questions related to 
the overall goals of PDSs. Since our implemen- 
tation of this model, increased enrollments 
have stretched our resources, and we are not 
adequately addressing the need to work closely 
with schools to provide professional develop- 
ment. Teachers have asked for professional 
development, and we question our ability to 
meet these requests given recent enrollment 
growth (> 300%). A second major concern 
relates to our graduates. We need to increase 
the number of graduates who participate in the 
evaluation of our program. Too many of our 
requests were returned simply because we did 
not know graduates’ current whereabouts. 

As an effort to systematically measure the 
impact of the PDS program and provide ongo¬ 
ing feedback to its stakeholders, the logic model 
of evaluation facilitated the self-assessment of 
the PDS program based on standards and pro¬ 
vided informative feedback for PDS program 
development. Participants’ positive rating and 
feedback regarding the impact of the PDS pro¬ 
gram on preservice teacher preparation, PDS 
partners, and teacher retention confirmed the 
program success over the past 3 years and gave 
us insights into how we might improve the 
program. To maximize program development 
based on the evaluation data, the logic model 
used in this evaluation summarized the key ele¬ 
ments of the program, identified the intended 
outcomes for the activities, and served as a 
useful means in communicating the vision and 
components of the program for all stakeholders 
involved. 

Limitations and Future Goals 

Although we developed surveys to gather 
information from graduating preservice teach¬ 
ers, their OSTEs, and program graduates in 
their 3rd year of teaching, we need to further 
explore program activities from faculty mem¬ 
bers involved in this program. We believe that 
their efforts in working with the preservice 
teachers in the teacher education program 


and the school partners through their ongoing 
professional development will help us better 
understand the comprehensive impact of our 
PDS program and provide insights for program 
development from a different perspective. As 
yet, we are unable to link the effectiveness 
of our program graduates to their students’ 
achievement levels, which is another critical 
aspect in examining the program’s impact. We 
therefore added in our logic model the faculty 
and K-12 student components as part of the 
data sources to guide future evaluation data 
collection and interpretation. 

Low return rates from program graduates 
limit the generalizability of our findings. Fu¬ 
ture effort to gather more demographic data, 
to keep in touch with our program graduates, 
and to connect student achievement data to 
our program graduates remains our goal de¬ 
spite the logistics of achieving it. Neverthe¬ 
less, the logic model that we have adopted for 
program evaluation remains flexible enough 
for us to continue using it to guide program 
improvement. E33 

Appendix A: Standards of 
the National Council for 
Accreditation of Teacher 
Education 

Standard 1: Learning Community 

• Support multiple learners 

• Work and practice are inquiry based 
and focused on learning 

• Develop a common shared profes¬ 
sional vision of teaching and learning 
grounded in research and practitioner 
knowledge 

• Serve as instrument of change 

• Extended learning community 

Standard 2: Accountability and 
Quality Assurance 

• Develop professional accountability 

• Assure public accountability 
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• Set professional development school 
participation criteria 

• Develop assessments, collect informa- 
tion, and use results 

• Engage with the professional develop- 
ment school context 

Standard 3: Collaboration 

• Engage in joint work 

• Design roles and structures to enhance 
collaboration and develop parity 

• Systematically recognize and celebrate 
joint work and contributions of each 
partner 


Standard 4: Diversity and Equity 

• Ensure equitable opportunities to learn 

• Evaluate policies and practices to sup¬ 
port equitable learning outcomes 

• Recruit and support diverse participants 

Standard 5: Structures, Resources, 
and Roles 

• Establish governance and support struc¬ 
tures 

• Ensure progress towards goals 

• Create professional development school 
roles 

• Resources 

• Use effective communication 


Appendix B: Development of Evaluation Surveys—Items by 
Professional Development School Mission and Standard 


Mission 

Preservice Teacher Survey 

On-Site Teacher Educator Survey 

Teacher education 



Standard 1 

1, 5, 7-9, 17, 29-32, 35-37 

1.3-1.5, 5, 8 

Standard 2 

2-10, 13-15, 19-26, 33-37 

1.1-1.5, 1.7-1.10, 1.12, 1.13, 5, 8 

Standard 3 

3, 5, 16, 17, 29-32, 35-37 

1 .11, 8 

Standard 4 

6-9, 27, 28, 35-37 

1.3-1.5, 5, 8 

Standard 5 

4, 11, 12, 16-18, 29, 31, 32, 35- 

-37 1.11,6-8 

Professional development 



Standard 1 


3.1-3.6, 8 

Standard 2 


3.1-3.6, 8 

Standard 3 


3.1-3.6, 8 

Standard 4 


3.1-3.6, 8 

Standard 5 


3.1-3.6, 6-8 

Student achievement 



Standard 1 

1, 5, 7-9, 17, 35-38 

1.3-1.5, 5, 8 

Standard 2 

10, 13-15, 35-38 

1.1-1.5, 1.7-1.10, 1.12, 1.13, 5, 8 

Standard 3 

3, 5, 16, 17, 35-38 


Standard 4 

6-9, 35-38 

1.3-1.5, 5, 8 

Standard 5 

35-38 

1 .11,6-8 
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